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Abstract 

M.Alekhnovich et al. recently have proposed a model of algo- 
rithms, called BT model, which covers Greedy, Backtrack and Simple 
Dynamic Programming methods and can be further divided into fixed, 
adaptive and fully adaptive three kinds, and have proved exponen- 
tial time lower bounds of exact and approximation algorithms under 
adaptive BT model for Knapsack problem which are 0(2"'/^/-^/n) = 
0(20-5"/^) and Q((l/e)i/3.i7) ^ Q((l/e)0-3i5)(for approximation ra- 
tio 1— e) respectively (M. Alekhovich, A. Borodin, J. Buresh-Oppenheim, 
R. Impagliazzo, A. Magen, and T. Pitassi, Toward a Model for Back- 
tracking and Dynamic Programming, Proceedings of Twentieth An- 
nual IEEE Conference on Computational Complexity, pp308-322, 2005). 
In this note, we slightly improved their lower bounds to ^(2^'^~''^^/^ / y/n) ~ 
0(20-66"/^) and l^((l/e) fi((l/e)0-420)^ ^nd proposed as an 
open question what is the best achievable lower bounds for knapsack 
under adaptive BT models. 

Key Words: Knapsack Problem, Exponential Time Lower Bound, Re- 
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1 introduction 

Many combinatorial optimization problems are NP-complete and probably 
have no polynomial time algorithms [1]. It is presumed that there are only 
exponential time algorithms for these problems, however, this has not been 
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proved. It is very hard to prove exponential time lower bound for these 
problems under universal model of algorithms, unless prove P ^ NP. Nev- 
ertheless, under some restricted model of algorithms, it is possible to prove 
exponential lower bounds for NP-complete problems. Alekhnovich et al have 
proposed a restricted model of algorithms, called BT model, which covered 
greedy algorithm, backtrack and simple dynamic programming [2] , and have 
proved exponential lower bound for Knapsack, Vertex Cover and SAT under 
this model. In this note, we slightly improved their lower bounds of exact 
and approximation algorithms for Knapsack problem under the adaptive BT 
model. 

2 A Glimpse on BT model 

In this section we quickly recall the relevant notions from BT models [2] . 
2.1 A description of BT model 

A combinatorial optimization problem P is represented by a set of data items 
D and a set of choices H. Each data item represents a partial structure of 
an instance. The set of choices contains all the possible choices which can 
be applied to data items. For example, in Knapsack problem, each item can 
be a data item and "chosen to be in the knapsack" and "chosen not to be in 
the knapsack" can be the set of choices. In the following, 0{S) denotes the 
set of all the orderings of all the elements in S. 

A BT algorithm A to a problem P is comprised of an ordering function 
r\ and a choice function c\: 

r\:D^xH^^ 0{D) 

is the ordering of unprocessed data items made by algorithm after the first 
k data items has been processed; 

4 : D'^+i xH''^ 0{H U {±}) 

represents the constraints made by algorithm when it makes choice for the 
k + 1th item according to the processed k data items and the choices for 
them. The algorithm consider only the choices before _L. If is a constant 
function and does not depend on D'^ or , then it's called fixed. If r\ 
depends on but not on , then it's called adaptive. If r\ depends on 
both and H^, then it's called fully adaptive. In this note, only adaptive 
BT algorithm is considered. 
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2.2 Lower bound strategies for BT model 

The lower bound strategies for BT model takes the form of a game between 
the adversary and the solver (the BT algorithm) [3]. In the game, since at 
the beginning the solver cannot see all the input data items, so the adversary 
always tries to produce a difficult problem instance for the solver. The game 
can be viewed as a series of rounds. The ith round is composed of three 
parts: Pi, Pli and Tj(i = 0, 1,2...). Pj is the finite set of data items owned 
by the adversary which cannot be seen by the solver in the ith patter. Pli 
is the set of data items representing a partial instance of the problem which 
have been seen by the solver in the ith pattern. And Tj is the set of partial 
solutions to Pli. See figure [T] 

Mem- Pg V Pj > P2 > Pj 




^ PI — ^Hj — ^ PI 2 — ^Pli 
To Tj T2 7; 

Figure 1: Model of solver-adversary 

At the beginning of the game, the solver gives an ordering rule on the 
input data items. And the adversary constructs rule of deleting data items 
according to the solver's rule and gives Pq. In this pattern, PIq is empty 
and To is also empty. In the ith{i > 1) pattern, solver picks a data item a 
from Pi_i and add it too P/j-i, and gets Pli = Ph-i U a. Then computes 
Ti in which every solution is an extension of some solution in Tj_i. Then 
adversary deletes a from Pi-i and some other data items and gets Pi. This 
process continues until Pi is empty. In the last pattern, if Pli is not a valid 
instance or Tj contains the optimum solution of PJj, then solver wins, or else 
adversary wins. 

If the set of all the solutions to Pli can be classified to some equivalent 
classes and for any partial solution PS to any equivalent class, there exists an 
instance A C PliUPi so that every optimum solution of A contains PS, then 
PS is called "indispensable" . If there exists a pattern in which the number of 
all the indispensable solutions is exponential with the scale of the problem, 
then the exponential lower bound of the problem can be achieved under the 
fixed or adaptive BT model. 
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3 Improved lower bound of Knapsack 

In this section we give the improved exponential lower bounds of exact algo- 
rithm and approximation algorithm on Knapsack under adaptive BT model. 
This improvement is obtained by setting parameters differently in original 
proofs in the work of M.Alekhnovich at. al [2]. 
Knapsack Problem 

Input: n pairs of non-negative integers, {xi,pi), ...,{xn,Pn) and a positive 
integer N. Xi represents the weight of the ith item and pi represents the 
value of the ith item. N is the volume of the knapsack. 



Simple Knapsack Problem 

Input: n non-negative integers {xi, x„} and a positive integer A^. Xi is the 
weight and value of the ith item and N is the volume of the knapsack. 
Output: 



Simple Knapsack problem is also NP complete [1]. So it is only needed 
to prove the exponential lower bound for simple Knapsack. In the following, 
we denote a simple Knapsack problem with n items and knapsack volume of 
N with {n,N). 

3.1 Lower Bound of Exact Algorithm 

M.Alekhnovich et. al proved the following theorem in [2]. 

Theorem 1. For simple Knapsack problem {n,N), the time complexity of 

any adaptive BT algorithm is at least 



Next we prove the following theorem. 
Theorem 2. For simple Knapsack problem {n,N), VO < e < 1/2, 3A^0; s-^- 
when N > Nq, the time complexity of any adaptive BT algorithm is at least 



Proof: Let / = {0, 1, all the weights of the items are from I. 



Output: 
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This is an constructive proof containing three steps. 
Step 1. 

Solver chooses the first (2 — e)n/3 items. After each, adversary deletes 
some items from the remaining by the following two rules. Let S be the set 
of the items which have been seen by the solver. 

(1) If S*!, 5*2 C 5", then delete items with weight of | ^ Si — ^ 521; 

(2) If 5*1 C S, then delete items with weight of — ^5*11; 
Step 2. 

Let P be the set of the first (2 — e)n/3 items chosen by solver. Now we 
prove: VQ C P and \Q\ = (2 - e)n/6, 3R C I - P, \R\ = (1 + e)n/3 and 
ExGQ ^ + Exgfl x = N. See figure El 




Figure 2: Constructing an indispensable partial solution 

Vg C P, let U = 3",a = j^Tej^iN - J:^^qx), J = {t\t e ZAt e 

[a — U, a + U]} (later we will prove J C /). Adversary chooses li^lli — 2 
items in J. After each, adversary will delete some items from the remaining 
by the following two rules. Let S be the set of items chosen by solver and 
adversary. 

(1) If 5*1, 5*2 C S, then delete items with weight of | ^ 5*1 — ^ S'2|; 

(2) If Si C S, then delete items with weight of — ^5*11; 

Let the sum of the weighs of these ii^^i!^ — 2 items be w. Then the 
adversary can choose items with weight bigger or smaller than a so that 

\w - a{n/2 -2)\ < U. 

Step 3. 

Adversary choose a pair of items from the following U + 1 pairs (later we 
will prove they are in /), such that the weight of these two items and the 
weight of the previously chosen items sum to A^: 

,v V 

+ = 1,2,. ..,[/ + ! 

in which v = N — J2Q ~ ''J^- 
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Since in the process of choosing items, the number of all the items does 
not exceed n, let this number be n^. Order these rit items by a fixed order, 
then every item corresponds to a single bit of a nj-bit O-l-(-l) string. And 
every such string corresponds to a deleted item in the previous process. In 
detail, let the sum of the weights of items corresponding to 1 in the string be 
Si, and let the sum of the weights of items corresponding to -1 in the string 
be If Si — s_i > 0, then delete item with weight of Si — s_i > 0; if 
si = 0, then delete item with weight oi N — s_i > 0. So the number of the 
deleted items does not exceed U. So in these f/ + 1 pairs of items, there must 
be one pair which is not deleted. Then we can choose this pair in the third 
step. 

Next we prove all the weights of the chosen items are in I. 
Because 



and 



' Pi n Fi 



n 
so 

SeN 3N 

<a< 



2{l + e)n - - {l + e)n 

clearly. 



Since 



3eA^ 3A^ 3N 

< — — <a< — < . 

~2{l + e)n~ ~{l + e)n~ n 



\w - a{n/2 - 2)1 < [/, 
3 



and 



so 



that is 



(l + e)n 
\v - 2a\ < U, 



U ^ U 
— < - < a + —. 
2 - 2 - 2 



So in the third step, the possible lightest and heaviest items are a— ^ — U — 1 



and a + ^ + U + 1. So in order that all the items chosen in the third step 
are from /, it is only needed that 
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that is 



a-|-t/-l > 
a + | + f/ + l < f 



3(l+£)n3"+2(l+e)n 
3e 

3(l+e)n3"+2(l+e)n 
6e 




So it is only need that > [— ]n3". In fact, N > [— ]n3"' is also sufficient 
to J C /. 

Next we prove that solver must keep all Q in P as partial solution in 
the computation tree, or else adversary can let the solver cannot find the 
optimum solution. 

We use the reduction to absurdity. Let Qi,Q2 C P and \Qi\ = \Q2\ = 
(2 — e)n/6. Ri and R2 correspond to Qi and Q2 respectively. If solver does 
not keep Qi, then adversary deletes all the items except Ri. If solver keeps 
Q2 to get the optimum solution, then there are only three cases(see figure E)): 









Ri 

, , 







Figure 3: Proof of indispensable of partial solution of Knapsack 

1) j:q2 + j:ri<n 

The optimum solution cannot be achieved in this case. 

2) ^Q2 + J:Ri = N 

So = ^ Q2. This is impossible. Since according to the first rule in 

the first step, the last chosen item in the first step which is contained in Qi 
or Q2 but not both cannot be chosen in the first step. 

3) EQ2 + ERi> N, thatisEQ2>EQi 

Assume R[ is a subset of Ri and it leads to the optimum solution with 
Q2. Then there are two cases: 

3.1) there is only one item in Ri — R[ 

According to the first rule in the first step, this item should be deleted. 

3.2) there are two or more than two items in Ri — R[ 
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If there is only one item in Ri — R[ which is chosen in the third step, 
then according to the first rule in the second step, it should be deleted. 

If there are two items which are chosen in the third step, then all the 
items in R[ are chosen in the second step. Let the choosing order of these 
items be ii, ...,is, then according to the second rule in the second step, the 
last item is should be deleted. 

So every Q in P is indispensable. So the time complexity is at least 



3.2 Lower bound of approximation algorithm 

M.Alekhnovich et. al proved the following theorem in [2]. 

Theorem 3. For simple Knapsack problem, using adaptive BT algorithm, to 

achieve 1— e approximation ratio, the time complexity is at least r2((l/e)^/^'^^). 

Next we prove the following theorem: 
Theorem 4. For simple Knapsack problem, using adaptive BT algorithm, to 
achieve 1— e approximation ratio, the time complexity is at least f^((l/e)^/^"^^). 
Proof:In theorem 2 we proved that for given n, N = [^]n3", < 6 < 0.5, 

the time complexity of simple Knapsack problem is Q{2^~^'"- / ^/n) . So the 
optimum solution cannot be achieved by algorithm with complexity of 7 = 
o(2^i~"/y^). Since the weight of item is integer, so the upper bound of 
approximation ratio is 

so 



7 = m/^) 



4.75 



For n,N,0<S < 0.5{N > [i±^]n3"), let N = [i±^]no3"°. So we can set 
the weights of n — no items in the n items to 0. 



4 Discussion 

In this paper, we slightly improved the exponential time lower bounds of 
exact and approximation algorithms under adaptive BT model for Knapsack 
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problem which are Vt{2^'^-'>'/^ / ^) « Vt{2^-^'^'' / ^) and Vt{{l/ tf'^'^^) ft; 
(]((l/e)0-420)_ 

We do not know whether our lower bounds are optimal. An interesting 
question is: what are the best achievable lower bounds for Knapsack problem 
under adaptive BT model? 
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